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Abstract 

We study, in a unified way, the following questions related to the prop- 
erties of Pontryagin extremals for optimal control problems with unre- 
stricted controls: i) How the transformations, which define the equivalence 
of two problems, transform the extremals? ii) How to obtain quantities 
which are conserved along any extremal? iii) How to assure that the set 
of extremals include the minimizers predicted by the existence theory? 
These questions are connected to: i) the Caratheodory method which es- 
tablishes a correspondence between the minimizing curves of equivalent 
problems; ii) the interplay between the concept of invariance and the the- 
ory of optimality conditions in optimal control, which are the concern of 
the theorems of Noether; iii) regularity conditions for the minimizers and 
the work pioneered by Tonelli. 

1 Introduction 

For more than three centuries, the calculus of variations played a central role 
stimulating the development of mathematics and the development of physics. 
Today, the calculus of variations, and its natural generalization known as the 
theory of optimal control, remain relevant and useful, generating new exciting 
and deep questions. There is a substantial progress in fundamental issues of 
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both theory and applications |9|, . In this paper we will address some of these 
questions. 

We study properties of the extremals and minimizers for various problems of 
the calculus of variations and optimal control. We are particularly interested in 
problems which may appear quite different but still can be reduced to the same 
problem if one uses appropriate transformations. Such problems are said to be 
equivalent. It turns out that for the equivalent problems there is a direct relation 
between admissible state-control pairs and the value for the cost functionals. In 
particular, after solving one problem, it is then straightforward to obtain the 
solutions for all the equivalent problems from the transformations which define 
the equivalence. 

The standard scheme to solve a problem in the calculus of variations or 
optimal control proceeds along the following three steps. First we prove that a 
solution to the problem exists. Second we assure the applicability of necessary 
optimality conditions. Finally we apply the necessary conditions which identify 
the extremals (the candidates). Further elimination, if necessary, identifies the 
minimizer(s) of the problem. As pointed out by L. C. Young Q, although 
both the calculus of variations and optimal control have born from the study of 
necessary optimality conditions, any such theory is "naive" until the existence of 
minimizers is assured. The process leading to existence theorems was introduced 
by Leonida Tonelli, in the years 1911-1915, through the so called direct method. 
It turns out that, even for the simplest problem of the calculus of variations, the 
hypotheses of the existence theory do not imply those of the necessary optimality 
conditions. This is to say that all the three steps in the above procedure are 
indeed crucial: it does not make sense to apply necessary optimality conditions if 
no solution to the problem exists; and it may be the case that a solution exist but 
fails to satisfy the standard necessary optimality conditions such as the Euler- 
Lagrange equations or the Pontryagin maximum principle. Therefore, regularity 
conditions are also an essential step in the process of solving a problem in the 
calculus of variations or optimal control. They close the gap between existence 
and optimality theories, assuring that all the minimizers are indeed extremals 

a. 

The study of equivalent problems in the calculus of variations and opti- 
mal control is not enough. It is also important to know how the extremals of 
the problems are related. In the terminology of Constantin Caratheodory || 
§227], two problems of the calculus of variations are said to be equivalent if 
the respective Lagrangians differ by a total derivative. The importance of this 
equivalence concept is due to the fact that it implies that the Euler-Lagrange 
equations are identical for both problems. One can say that for Caratheodory 
is the correspondence between the extremals, and not that of the problems, the 
key concept to define equivalence. To the best of our knowledge this concept of 
Caratheodory-equivalence has not been previously explored, or even considered, 
in the optimal control context. Here we will be mainly interested in the follow- 
ing trivial but important remark: two Caratheodory-equivalent problems have 
"the same" conservation laws. This is not necessarily the case for equivalent 
problems: equivalence does not imply Caratheodory-equivalence and the other 
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way around. Surprising enough, when one restrict attention to the abnormal 
extremals, the two concepts seem to be quite the same. 



Conjecture 1.1. Two problems of optimal control are equivalent if, and only 
if, they are abnormal-Caratheodory-equivalent. 



We will show in Section ||the validity of Conjecture 1.1 for equivalent prob- 



lems under transformations of the type of Gamkrelidze [|10| §8.5] and under a 
time-reparameterization introduced by the author in p7| . 

Conservation laws, that is, conserved quantities along the extremals of the 
problem, are obtained in the calculus of variations with the help of the famous 
symmetry theorems of Emmy Noether. These classical results are known as the 
(first) Noether theorem and the second Noether theorem, and explain the corre- 
spondence between invariance of the problem with respect to a family of trans- 
formations and the existence of conservation laws. The first Noether theorem 
establishes the existence of p conservation laws of the Euler-Lagrange differential 
equations when the Lagrangian L is invariant under a family of transformations 
containing p parameters. The second Noether theorem establishes the existence 
of k (m + 1) conservation laws when the Lagrangian is invariant under a family 
of transformations which, rather than dependence on parameters, as in the first 
theorem, depend upon k arbitrary functions and their derivatives up to order m. 
Extensions of the first theorem for the Pontryagin extremals of optimal control 
problems are available in [^7], |24|, |2[| . In Section |^ we provide a rather general 
formulation of the first Noether theorem which envolves all the peculiarities of 
previous results. For optimal control versions of the second theorem we refer the 
reader to |^6| . We will argue in Section |] that the conservation laws obtained 
from the use of Noether's first theorem play an important role in the acquisition 
of regularity conditions. 

Further extensions and related results are possible. Due to the restrictions 
on the volume of the paper we can not provide them here. The reader can find 
more details, complete and detailed proofs, illustrative examples, additional 
material and a complete list of references, in the author's thesis [^8), available 
in Portuguese. 



2 Caratheodory-Equivalence 

In this section we address, under two types of transformations involving change 
of the time-variable t, the following question: How the transformations, which 
define the equivalence of two problems, affect the Pontryagin extremals? First 
we will need to introduce the problem considered in optimal control theory, and 
to give a characterization of the Pontryagin extremals. 

The objective of the paper is to study some properties of the minimizing 
trajectories for general problems of optimal control in the case where controls 
are unconstrained, like in the calculus of variations. We will be considering, 
without any loss of generality, problems in the Lagrange form. This is indeed a 
general problem, and Bolza type problems or Mayer type problems can be put 
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easily in this form. We look for a pair (x(-), satisfying a control dynamical 

equation described by a system of ordinary differential equations 



x(t) = <f(t,x(t),u(t)) , (1) 
in such a way the pair (a;(-),u(-)) minimizes a given integral functional: 

I[x(-),u(-)]= ( L(t,x(t),u(t))dt — >min. 

J a 

This problem is denoted by (P). The state trajectories x(-) are assumed to be 
absolute continuous functions and the admissible controls u(-) to be Lebesgue 
integrable: 

x(-) S W\.i ([a, b] ; R") , u(.) 6 Li ([a, b] ; W) . 

For simplicity of exposition, we will assume that the Lagrangian L and function 
if are C 1 -smooth with respect to all variables. The results of the paper are 
valid for all kinds of boundary conditions one may want to consider. For this 
reason, boundary conditions are not considered in our formulation of the optimal 
control problem. We remark that, a priori, optimal controls may be unbounded 
and that the problems of the calculus of variations, like the basic problem of 
the calculus of variations or the problems with high-order derivatives, can be 
reduced in the obvious way to the Lagrange problem (P). 

Both the calculus of variations and optimal control theory have born from 
the study of first-order necessary optimality conditions: the Euler-Lagrange 
equations, in the case of the calculus of variations, which appear in the Euler's 
celebrated monograph of 1744, and the Pontryagin maximum principle, in the 
case of optimal control, which appear ~ 1956. The Pontryagin maximum prin- 
ciple gives conditions under which all the minimizers are Pontryagin extremals. 

Definition 2.1. The quadruple (x(-), «(■), ipo, V'O)' - 0, ^ (') e 
(ipo, 7^ 0, is a Pontryagin extremal if it satisfies: 



the Hamiltonian system 



dH ■ _ dH 

dtp ' dx 



the maximality condition 

H (t, x(t), u(t), ipo, ip(t)) = mstxH (t,x(t),u, ipo, ip(t)) 



with the Hamiltonian H(t, x, u, ipo, tp) = ipo L (t, x,u) + ip ■ cp (t, x, u). An ex- 
tremal is said to be abnormal when ip vanishes and normal otherwise. 

The first equation in the Hamiltonian system is just the control equation 
(Q). The second is known as the adjoint system. 
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For the basic problem of the calculus of variations one has x = u and the 
Hamiltonian is given by H = iJjqL + ip ■ u. From the adjoint system we obtain 



-WO TT" ■ 

ox 



while from the maximality condition one gets 

/ / dL 
du 



(2) 



(3) 



The maximum principle asserts that ipo & n d do not vanish simultaneously 
and it comes immediately, from (||), that no abnormal minimizers exist for the 
basic problem of the calculus of variations. From equalities (J2J) and (g) one 
concludes that if x(-) is a minimizer it satisfies the Euler-Lagrange equations: 



d dL 
dt du 



(t,x(t),x(t)) 



dL 

dx 



(t,x(t),x(t)) 



(4) 



A solution x(-) of (Q) is called an (Euler-Lagrange) extremal. The classical 
conditions [ fl8|| , assuring that all minimizers are extremals, assume that the 
Lagrangian L and function ip are continuous with respect to all variables and 
continuously differentiable with respect to the state variables x; while the op- 
timal controls are assumed to be essentially bounded: L(-,x, •), f{-,X, ■) G C, 
L(t,-,u), ip(t,-,u) £ C 1 , u(-) e Loo. For the basic problem of the calculus of 
variations, this means that the Euler-Lagrange equations are valid for mini- 
mizers in the class of Lipschitzian functions. Proving general versions of the 
maximum principle under weaker hypotheses is still very much in progress p2| . 
Conditions with it(-) S L\ do exist, but they postulate growth conditions on 
the Lagrangian L and functions ip. For example, the following conditions follow 
easily from Berkovitz's H or Clarke's version of the maximum principle pfl: 



dL 

dx 



<c\L\ 



k. 



dipi 



dx 



< c \ipi\ + k , 



(5) 



i = 1, . . . , n, for some constants c > and k. 

The following theorem provides an interesting property of the Pontryagin 
extremals. 

Theorem 2.1 ([^§). Let F (t,x,u,ip ,ip), F : [a, b] x R™ xR r xK x M™ -> E, 
be a continuous differentiable function with respect to t, x, ipo, an d V> for fixed 
u. If there exists a function G(-) £ L\ ([a, b];M) such that 

\\y it ,x,^F(t,x(t),u(s),i;o,^(t))\\ < G{t) (s,t£ [a,b]) , 
and for almost all t 's in the interval [a, b] the condition 



F (t,x(t),u(t), ip ,ip(t)) = ma,xF(t, x(t),v,ip ,ip(t)) 
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is true along the Pontryagin extremals (#(•), u(-), ^>q, ?/>(•)) of the optimal control 
problem (P), then t — > F (t,x(t),u(t),tpo,tp(t)) is absolutely continuous and the 
equality 



dF _ dF dF dH dF dH ^ dF 

dt dt dx dtp dtp dx dt 



{F,H} 



holds along the extremals, where {F, H} denotes the Poisson bracket of the func- 
tions F and H , and on the left-hand side we have the total derivative with respect 
to t, and on the right-hand side partial derivatives. 



If one chooses F in Theorem 2.1 to be the Hamiltonian H, one gets: 

Theorem 2.2. If (#(•), u(-), tpo, V'(')) * s a Pontryagin extremal, then the func- 
tion H (t,x(t),u(t),tpo,tp(t)) is an absolutely continuous function oft and sat- 
isfies the equality 



dH dH 

— (t, x{t), u{t),tp , tp(t)) = — (t, x(t), u(t), Vo, W)) 



(6) 



Equation (^) corresponds, for the basic problem of the calculus of variations, 
to the classical DuBois-Reymond necessary condition: 



dt 



dL 

L (t, x(t),x(t)) - x(t) ■ — (t, x(t), x(t)) 



dL 
dt 



(t,x(t),x(t)) . (7) 



From our Theorem 2.1, a necessary and sufficient condition for a function F 
to be a conservation law is immediately obtained. 



Corollary 2.3. Under the conditions of Theorem 2.1, F(t,x,u,tpo,tp) is con- 
stant along every Pontryagin extremal of the problem if, and only if 



dF 
dt 



dF dH 

dx dtp 



dF dH 

dtp dx 



0. 



Corollary 2.3 is very useful for the characterization of optimal control prob- 
lems with given conserved quantities along the Pontryagin extremals. For ex- 
ample, if one wants to find a problem for which the function 



F = Hipx 



(8) 



is constant in t along the respective extremals, a necessary and sufficient condi- 
tion is given by the relation 

. dH . dH TT dH n 
tPx— + tPH— - Hx— = . 
dt dtp dx 

One such problem is therefore 



L(u(t))dt > mi: 

x{t) =tp{u{t))x{t) 



(9) 



G 



Usually, the form of the problem is already known and conditions are sought in 
such a way that the problem as some "good" properties. Let us see one such 
situation. The following problem is related to the study of cubic polynomials 
on Riemannian manifolds: 

V] (ui(t)) 2 dt — ► min , 
i=i 

(xi(t)=x 2 (t), 

The problem is autonomous and from (|^) we know that the respective Hamilto- 
nian H is conserved along the extremals. Determination of the explicit solutions 
to problem ( ^0| ) is a difficult task and is, in general, an open problem. How- 
ever, the extremals can be explicitly computed if a new independent conserved 
quantity is found. The question is: what kind of conditions shall we impose 
on the vector fields AQ in order to obtain the new conserved quantity? To an- 
swer this question one needs to solve a characterization problem as before. Let 
F = kitpixi + k 2 ijj 2 x 2 {k\ and k 2 constants). This is c alled in the literature a 



momentum map. Using the relation given by Corollary 2J5 one gets 

kitpix 2 + k 2 ip 2 {X\{xx)ux H h X n (x\)u n ) 

- kxXx^Ji (X[(xi)ui H h X' n (xi)u n ) - k 2 x 2 ipi = . 

This condition is trivially satisfied if k\ — k 2 and X'^x^xi — Xi(xi), i = 
1, ... , n. We have just proved the following proposition. 

Proposition 2.4. // the homogeneity condition 

Xi {Xxi) = AXi(xi), i = 1, ... , n, VA> 0, (11) 

holds, then 

Mt)xi(t) + lp 2 (t)x2(t) 

is constant in t £ [0,T] along any extremal of the problem (|l0|). 

We shall elaborate more on t his issue later, in Section ||, in relation with 
Noether's theorems (cf. Example |3.6| ). 

After this short introduction to Pontryagin extremals and their characteriza- 
tion, we are now in conditions to study how the extremals are affected when one 
transforms problem (P). Let us consider the following optimal control problem: 

J [*(•), z(-), «(•)] = / T (i(r), z(t), v(t)) L (t(r), z(t),v(t)) dr — > min , 



(12) 



t'{r) =T(t(r),z(r),v(r)) 

z'{t) = T (t(r), z(t), v(t)) ip (t(r), z(r), v(t)) 

v : K -> R r , 
t{ Ta ) = a, t(T) = b, 
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where T (•,•,•) is a strictly positive continuously differentiable function, 

C 1 3 T(t, z, v) : K x R n x K r -> R+ , 

and T is free. Problem ( |l^ ) is obtained from (P) by entering a new time variable 
r, related with with t by the relation 

r{t) =r a + [ 1 dfl , t e [a, 6] . (13) 

Compared with (P), problem ( |l2| ) has one more state variable. Namely, its 
state variables are t(-) and z(-). We note that the problem is autonomous: both 
the Lagrangian and the right-hand side of the control system do not depend 
directly on r. Thereafter, the admissible set of problem (|l2|) is invariant with 
respect to translations on the time variable r. For the concrete situation wherein 
r a = and T(i, z, v) — L ^ z ^ , one obtains the transformation introduced 
by R. V. Gamkrelidze Chap. 8], of the Lagrange problem (P) into the 
autonomous time optimal problem. 

We denote by H the Hamiltonian associated with problem (P), and by H 
the Hamiltonian associated with (|l2|): 

H (t, x, u, ipo,i>) = ipoL(t, x,u) + ip ■ ip(t, x, u) , 
U (i, z,v,po,p t ,p z ) = [poL(t, z,v)+p t +p z ■ ip(t,z,v)] T(t,z,v) . 



As far as TL does not depend on r, it follows from Theorem 2.1 that TL = const 
along an extremal. The following theorems assert that the extremals of problem 
(P) are related to those extremals of problem (|l^) for which this constant is 
zero. 

Theorem 2.5 ([g). Let (t(r), z(t), w(r),p ,p t (T),p z (r)) 7 r G [r a ,T], be a 
Pontryagin extremal of problem ( |l^ ) with 

H(t(T),z(T),v(T),po, Pt (r),Pz(r))=0. (14) 

Then (x(t),u(t),ip ,ip(t)) = (z(r(t)),v(T(t)),po,p z (T(t))) , t G [a, 6], where r(-) 
is the inverse function oft(-), is a Pontryagin extremal of (P). Moreover, the 
value for the functionals coincide: 

I [x(-),u(-)} = J [*(■),*(■) A')} ■ (15) 

Theorem 2.6 ([^8|). Let (x(t), u(t), ipo, ip(t)), t G [a, b], be a Pontryagin ex- 
tremal of problem (P). Then, with t(-) the inverse function of (|l3|) 7 

(t(r),z(r),v(T),p ,pt(T),p z (r)) = (t(r),x(t(T)),u(t(T)),ip , 

-H (i(r), x(t(T)),u(t( T )),%^(t(T))) , i/>(t{r))) , 

r G [r a ,T], is a Pontryagin extremal of ( |T^ ) which satisfies equalities ( |l4| ) and 
151). 
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We remark that the correspondence given by Theorems 2.5 and 2.6 keeps 
the normality or abnormality of the extremals (i/>o = po). 

Similar correspondences between the extremals, to the one established by 
Theorems |2.5| and 2.6, can be obtained under different transformations of the 
problem (P) . One such transformation is based on an idea of time reparameter- 
ization introduced by the author in j27| . The idea generalizes a well known time 
reparameterization that has proved to be useful in many different contexts of the 
calculus of variations and optimal control (see references in [^7|). Considering t 
as a dependent variable, we introduce a one to one Lipschitzian transformation 
[a, b] 3 t 1 — > r g [a, b], £pt(r) > 0, such that 

L (t, x(t),u(t)) At — L (t(r),x(t(T)), u(t(r))) ^ dr , 

±x (*(r)) = « = p W r), X (t(r)) , u (t(r))) ^ . 

In this way, if one consider the notations z(r) = x(t(r)) and w(t) — u(t(r)), 
problem (P) takes the form 

K [*(•), «(•),«(•), «»(•)] = / i w(r)) w(r) dr — > min 

ff(r)=«(r) (Pt) 
I = 95 z(r), w(r)) u(r) 



i(a) = a , t(b) = b , 
*(•) 6 W hoo ([a,b]; [a,b]) , z(-) g ([a, b]; R B ) , 
w(-) eioo([a,6];K + ) , H')eii([«,6];R r ) . 

For the new transformed problem (|p71 ), the state variables are t(r) and z(t) 
while the controls are u(r) and u>(r). The fact that the control variable u(-) 
takes only strictly positive values, assure that t(r) has an inverse function r(t). 
Next theorem shows how to construct an extremal of (P) given an extremal 



of problem ( Pi- 



Theorem 2.7 ([|30|]). Let (<(•), z(-), v( ), w(-),po,pt(),Pz(')) be an extremal of 
([P]). Then 

(*(•), «(•), Vo,#)) = (* (r(-)) , U) (r(-)) ,Po,p 2 (t(-))) , 

where r(-) is t/ie inverse function oft(-), is an extremal of (P) with the same 
value for the functional: I [&(•), it(-)] = [t(-), z(-), «(•), . 



The transformed problem (P T ) is autonomous, and we already know that 
the corresponding Hamiltonian is constant along the extremals. As before, for 
the Gamkrelidze-type transformations, to a Pontryagin extremal of the original 
problem (P) one can correspond an extremal of the transformed problem for 
which the Hamiltonian vanishes. 
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Theorem 2.8 ([^o|). Let (x(-), u(-), ipQ, ip(-)) be a Pontryagin extremal of(P). 
Then, for all v(-) £ Loo([a, b]; M + ) such that J v(9) d6 = b — a, the 7-uple 
(t(-)> z (-). ! '(').' 1 '(-).Po,Pt('),p z (-)), defined by 



t(r) 



v(0) dd, 



z(t) = x (t(r)) , w(t) =u(t(r)) , 

P0=^0, Pz(t) ^ tfj(t(T)) , 

pt(r) = -H(t(r),x(t(r)),u(t(r))^ ^(t(T))) , 



is a Pontryagin extremal of (P T ) giving a zero value for the respective Hamil- 
tonian. Moreover, K [t(-), z(-),v(-),w(-)] — I [x(-),u(-)]. 



From Theorems 2.7 and |2.8| the following corollary is trivially obtained. 



Corollary 2.9. If (x(t),u(t)) is a minimizer of (P), then the quadruple 

(<(t),z(t),i;(t),w(t)) = (t,x(t),1,u(t)) 
furnishes a minimizer to (p^j). 



Once again, Theorems |2.7| and [2^ establish a correspondence between the 
abnormal extremals of the original and transformed problem. 

Corollary 2.10. If no abnormal extremals exist for the problem (P), then no 
abnormal extremals exist for the problem (P T ) too. If no abnormal extremals 
exist for the problem (P T ), then no abnormal extremals exist for the problem 
(P) too. 

We shall see in Section || that one can obtain regularity conditions, assuring 
that all minimizing controls of (P), predicted by Tonelli's existence theorem, 
are Pontryagin extremals, from the applicability conditions of the Pontryagin 
maximum principle to the transformed problems. The proof relies on certain 
conserved quantities along the Pontryagin extremals. These conserved quanti- 
ties are addressed in the following section. 



3 Noether Symmetry Theorems 

We now turn our attention to the following question: How to obtain quantities 
which are conserved along the Pontryagin extremals? This is an important, 
profound, and far-reaching litigation. Such conserved quantities can be used to 
lower the order of the Hamiltonian system of differential equations and simplify 
the resolution of the optimal control problem. They are also important for many 
other reasons. In the calculus of variations they have been used to synthesise 
the Lavrentiev phenomenon Jl3| while in control, to analyze the stability and 
controllability of nonlinear control systems, they are used for the system de- 
composition in terms of simpler lower dimensional subsystems |12[. These are 
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just few examples, but many other applications are possible: proving existence 
of minimizers, solving the Hamilton-Jacobi-Bcllman equation, etc. We show 
that conserved quantities along the extremals are also a useful tool to prove 
Lipschitzian regularity of the minimizing trajectories. 

We will obtain some generalizations of the well known theorems of E. Noether, 
providing a connection between such conserved quantities and the invariance of 
the problems in optimal control. The theory of this connection, as it appears 
in many branches of classical theoretical physics, constitutes one of the most 
beautiful chapters of the calculus of variations. 

The universal principle described by Noether's theorems of 1918, asserts that 
the invariance of a problem with respect to a family of transformations implies 
the existence of conserved quantities along the Euler-Lagrange extremals. 

Definition 3.1. If C 1 3 h s (t,x) = (h s t (t), h s x (x)) : [a, b] x R" -> R x R", 

s G (-£,£); h°(t,x) = (t,x) for all (t,x) G [a, b] x R n ; 

' b) L (t s ,h s x (x(t s )) , 4:K «t S ))) ^ = t L (t, x(t), x(t)) dt , 



fc°(a) 



dt s 



for t s — hf(t), all s £ (— e, e), and all x(-); then the basic problem of the calculus 
of variations is said to be invariant under h s . 

Theorem 3.1 (First Noether's Theorem). If the basic problem of the cal- 
culus of variations is invariant under h s , then 



m . K (x(t))\ s=Q -H(t,x(t),x(t),m) §~ s K (t)\ s=0 (16) 
is constant in t along every extremal. 

We recall that for the basic problem of the calculus of variations one has 
ijj = — 1 and tp = Quantity ( [l6| ) is then equivalent to 

^-(t,x(t),x(t))-^-h s x (x(t))\ s=Q 

d 



dL 

L (t, x(t), x(t)) - — (t, x(t), x(t)) ■ x(t) 



g- s hl(t)\ s=0 . (17) 



If the Lagrangian L does not involve the time variable t explicitly, one has in- 
variance relative to translation with respect to time: one can choose hf(t) = t+s 



and h s x (x) = x in Definition 3.1. It follows from Theorem 3.1 that the corre- 
sponding Hamiltonian is a first integral of the Euler-Lagrange equations. At the 
light of (O), this is nothing more than the classical 2 nd Erdmann condition, 

dL 

L (x(t), x(t)) - — (x(t), x(t)) ■ x(t) = constant , (18) 
ou 

which is a first-order necessary optimality condition for the autonomous basic 
problem of the calculus of variations. Condition dl^) can also be obtained as a 
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straight corollary from the DuBois-Reymond necessary condition (R) discussed 
in Section and one can already guess the interplay between the concept of 
Caratheodory equivalence and Noether theorems. Such relation is the central 
key to obtain our generalizations. This is in contrast with the classical proof of 
Theorem |3.1| , which is based on the so called "general variational formula" jll], 
pp. 172-198]. We claim that the proof based on Caratheodory approach is more 
far- reac hing than the traditional procedure. We will obtain a version of Theo- 
rem |3.l| to the optimal control setting with several extensions and improvements 
(cf. Theore m |3.3| below) . 

Theorem 3.1 comprises all theorems on first integrals known to classical and 
quantum mechanics, field theories, and has deep implications in the general 
theory of relativity. For example, in mechanics ([l8]) correspond to the energy 
integral of conservative systems, a conservation law first discovered by Leonhard 
Euler in 1744; while applying Noether's principle to the Lagrangian describing a 
system of point masses, one obtains conservation of linear momentum or angular 
momentum, corresponding, respectively, to invariance under spatial translation 
or spatial rotation.^] 

As already mentioned, Noether's theorem can be considered as an universal 
principle. Well known classical formulations include invariant problems of the 
calculus of variations defined on a manifold M; problems of the calculus of 
variations with multiple integrals; invariance notions with respect to more than 
one parameter; families of maps depending upon arbitrary functions (second 
Noether theorem); invariance of the Lagrangian up to addition of an exact 
differential d$(t, x, s), with <i> linear on the parameter s. In the original paper 
[ p~7| , Noether explains that the derivatives of the state trajectories x(-) may also 
occur in the family of transformations h s . However, this possibility has been 
forgotten in the literature of the calculus of variations. From our point of view, 
this possibility is very interesting: it means that the parameter transformations 
h s may also depend on the control variables. 

Recent formulations, in other contexts than the calculus of variations, in- 
clude the ones obtained by van der Schaft [j32[ for autonomous Hamiltonian 
control systems with inputs and outputs; the results of Carihena and Figueroa 
[0 for (higher-order) supermechanics; and the discrete versions, in which time 
proceeds in integer steps, obtained by Baez and Gilliam H. In the optimal 
control setting, the important relation between invariance of the problem under 
a parameter family of transformations, and the existence of preserved quanti- 
ties along the Pontryagin extremals, was established by Djukic f3~l]| , Sussmann 
[|l), Jurdjevic fl|, Ch. 13], Blankenstein & van der Schaft f§, and Torres §7|. 
Our purpose here is to provide a Noether type theorem to generic problems of 
optimal control in a broader sense, enlarging the scope of its application. Our 
results will be formulated under a weak notion of invariance which admits sev- 
eral parameters, equalities up to first order terms in the parameters, addition of 
an exact differential, not necessarily linear with respect to the parameters, and 

1 In this context the Hamiltonian multiplier i/>(-) represent the generalized momentum of 
the system. 
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a family of transformations which may also depend on the control variables. We 
will make use of a technique different from the classical one. This technique, 
introduced by the author in (27]] , does not need to use transversality conditions 
as happens in the classical proof. For this reason, the results will be valid even 
in the situation when we do not know the boundary conditions. 

We begin with a Noether theorem with no transformation of the time vari- 
able. 

Definition 3.2. Let h s : [a,b] xR"xI r ^ R n , 
s = (si, ... ,s p ) , \\s 



\ k=l 



be a p-parametric family of C 1 transformations which for s — reduce to 
identity: 

h°(t, x,u)=x, V(i, x, it) S [a, b] x M" x W . 

If there exists a function <f> s (i, x,u) £ C 1 ([a, b], R n , R r ; R) and for all s = 
(si, ... ,s p ), \\s\\ < e, and admissible (x(-),u(-)) there exists a control u s (-) S 
Loo ([a, 6]; R r ) such that: 

L(t,h s (t,x(t),u(t)),u s (t)) dt 

' d \ 

x(t),u(t)) + 3-$ s (i, x(t),u(t)) + 6 (t, x(t), u(t),s) dt (19) 



dt 

for all /? G [a, 6]; 

^ s (t, a;(t), u(t)) + <5 (t, x(t), u(t),s) = <p(t, h s (t, x(t), u(t)), u s (*)) ; (20) 

where (5 (t, a;, it, s) denote terms which go to zero faster than for each f, x, 
it, i.e., 

5(t,x,u,s) 

hm = , 

MI-0 ||s|| 

then problem (P) is said to be quasi-invariant under h s (t, x, it) up to $ s (t, x, it). 

The following examples illustrate some of the new possibilities. 

As far as in Definition |3.2j <£> s may depend on the parameters in a nonlinear 
way, one may cover new situations even for the basic problem of the calculus of 
variations. Example 3T illustrate this issue. We also note that in the example 
the state-transformation h s depend not only on the state variable x but also on 
time t. 
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Example 3.1 (n = r = 1). Consider the following basic problem of the calcu- 
lus of variations: 

rb 

(u(t)) dt > min , 

x(f) = u(t) . 

In this case we have L = u 2 and tp = u. The problem is invariant, in the sense 
of Definition |3.2| , under the one-parameter transformation h s (t,x) = x + st 
(h°(t,x) — x). Indeed, we observe that for Q s (t,x) = s 2 t + 2sx and u s (t) — 
u(t) + s (u°(t) — u(t)) one obtains: 



rP 



L{u s (t))dt = (u(t) + sfdt = ((u(t)) 2 + s 2 +2su(tj) 



dt 



L(u(t)) + ±$'(t,x(t))) dt: 

^-h s (t,x(t))=x(t) + s = V> (u s (t)) . 
dt 



The optimal control problem in Example 3.2 is quasi-invariant under a one- 
parameter family of transformations up to an exact differential. 

Example 3.2 {n = 3, r = 2). Let us consider the following optimal control 
problem: 

(ui(<)) 2 + {u 2 (t)fdt — > min , 

' x\(t) = iti (i) , 

x 2 (t) = u 2 (t) , 

. ... u 2 (t) (x 2 (t)) 2 
. x 3[t) = 2 • 

One has L{ui,u 2 ) — u\ +tt|, </J (2:2, Ui, U2) — [ui,U2,-^ 2 - 2 -^j and direct com- 
putations show that the problem is quasi-invariant under 

h s (t,x 1 ,x 2 ,x 3 ) = (h s Xi (t,Xi),h s X2 (t,x 2 ) ,h a X3 (t,x 2 ,x 3 )) 

xi + st, x 2 + st, x 3 + -x 2 st 

up to <i> s (xi, x 2 ) = 2s (xi + x 2 ): h (t, x%, x 2 , X3) = [x\, x 2l X3) and by choosing 
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if = u\ + s and u 2 = u 2 + s (u^ = u\, u 2 = u 2 ) wc obtain 



L(u?(t),u|(t))di = / ( Ul (t) + s) 2 + (u 2 (t) + s) 2 dt 



[(ui(t) 2 + u 2 (» 2 ) + 2s (ui(t) + u 2 (tj) + 2s 2 ] dt 



P r 



L ( Ul (t),u 2 (t)) + - (<S> S ( Xl (t),x 2 (t))) + S(s) 



dt. 



that is, equation ( |19| ) is satisfied with S(s) — 2s 2 ; 

^ «(*)) = Ul (t) + s = + st) - ^ (Wi)) , 

^2 (t^ (t) ) = ua(t) + a = — (as 2 (*) + **) = ^ fc' a (t, x 2 (t) ) , 



df 



(fc* a (t,x a (t)),u5(*)) = 



(«2(*) + «) (x 2 (t) + sff 



+ + 2* a (t)« a (t)*) -r- 

^ (x 3 (t) + ^x 2 (t) 2 s?j + S (t, x 2 (t), u 2 (t), s) 
^K 3 (t,x 2 (t),x 3 (t))+S(t,x 2 (t),u 2 (t),s) , 



2 „3 



(u 2 (i)r + 2x 2 (t)t) s 2 +t 2 s 



and therefore 



is also satisfied. 



Theorem 3.2. If (P) is quasi-invariant under the transformations h s (t,x,u) 
up to <f> s (t,x,u), in the sense of Definition 3.&, then the p quantities 



d d 
m-^h s (t,x(t),u(t))\ s=Q +^ Q —<P s (t,x(t),u(t))\ s=Q , (k=l,...,p), 

OSk OSk 



are constant in t along every Pontryagin extremal (x(-), u(-), ipo> °f the 

problem. 



Example 3.3. From Theorem it follows that ip(t)t+2ipox(t) is constant in t 
along the ex trem als of the basic problem of the calculus of variations considered 
in Example 3A. We know that ip(t) — |^ (t,x(t),u(t)) and ?/>o = — lj so the 
conclusion is that x(t)t — x(t) is a first integral of the Euler-Lagrange differential 
equations. 
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Example 3.4. One concludes from Theorem 3.2 that 2-00 ( x i(t) + %a(t)) + 
ipi{t)t + ip2{~k)t + 5^3 W {x2{t)) 2 t is constant along all the Pontryagin extremals 
of the problem considered in Example |3.2|. 



Example 3.5. Problem W) is invariant under the one-parameter family of 



transformations h s (x) — e s x (cf. Definition 3.2 with u s = u and <& s = 0) 



We get from Theorem 3.2 that 

ip(t)x(t) = constant , (21) 
£ G [a,b], along any Pontryagin extremal of problem (H). 



Example 3.6. Under the condition ( flip problem ( |l 0| ) is invariant under h%. 



e s xi,ht — e s X2, with uf — m and $ s = 0. Proposition 2.4 follows from Theo- 



rem 3.2. Other conclusions are also possible if one imposes different conditions 



on the vector fields Xi (cf. Example 3.7) 



We now generalize the invariance notion given by Definition |3.2| , in order 
to admit the possibility of a p-parametric transformation of the independent 
variable t. 

Definition 3.3. Let h s (t, x, u) = (hf(t,x,u), h s x (t,x,u)), hf : [a,b]xR n xR r -> 
R and h% : [a,b] xK" xl r — > M" (||s| < e), be a p-parametric family of C 1 trans- 
formations which for s — satisfies h (t, x, u) = (t, x) for all triple (t, x, u) S 
[a, b] x R" x R r . If there exists a function <J> s (i, x, u) G C 1 ([a, 6], R™, R r ; R) 
and for all s = (si, . . . , s p ) and for all admissible pair (&(•), «(•)) there exists a 
control it s (-) G Lqo ([a, 6]; R r ) such that: 

L (t s , h 6 x (t s ,x(t s ),u(t s )),u s (t s )) dt s 

hi (a.x(a) ,u(a)) 

( d \ 

f L(t, x(t),u{t)) + ^ s (t, x(t), u(t j) + S (t, x(t), u(t),s) J dt , 

for all (3 G [a, b]\ 

A-h x (t s ,x(t s ), u(t s )) + S (t, x(t), u(t),s) = V (t s , h x (t s ,x(t s ),u(t s )), u s (t s )) , 



for t s = ht(t, x(t), u(t)); then the problem (P) is said to be quasi-invariant under 
transformations (/z£ (t, x, u), h x (t,x,u)) up to $ s (i,x, u). 

What follows is a more general version of the first Noether theorem which 



admits transformations of the time- variable. Theorem 3.3 gives p conservation 
laws when the optimal control problem (P) is quasi-invariant up to $ s under a 
family of transformations with p parameters. 
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Theorem 3.3 (First Noether Theorem for Optimal Control). If (P) is 

quasi-invariant under the transformations (h%(t, x, u), h s x {t 1 x, u)) up to $ s (t, x, u), 
in the sense of Definition 3.S, then 



d d 
m ■ K{t, x(t), u(t))\ s=0 + ^o— $ s (i, x (t), u(t))\ s=0 
ask osk 

- H (t, x(t), u(t), </>o, i>(t)) K{t, x(t), u(t))\ s=Q 

is constant in t along every Pontryagin extremal (x(-), u(-), ipo, of the prob- 
lem Vfc = 1, . . . , p. 



rem 



The proof of Theorem 3.3 is done by reduction to the situation of Theo- 



3.2| . If (P) is quasi-invariant under (h s t (t, x, u),h^(t, x, u)) up to x, uY 



in the sense of Definition 3J3, then the problem (P r ) introduced in Section |2] 
is quasi-invariant under h s (t, z, w) = (/if(t, z,w), h^(t, z,w)) up to $ s (i, z,w) 
in the se nse o f Definition 3.2. The pretended conclusion is then obtained from 
Theorem ^8. 



Remark 3.1. Every autonomous problem is invariant under hf = t + s and h s x 



x (autonomous problems are time- invariant). It follows from Theorem 3.3 that 
the corresponding Hamiltonian H is constant along the Pontryagin extremals 
(cf. equality (||)). For the time-invariant problem (||), this fact, together with 
the conservation law ( pl| ) , gives an alternative explanation for (^) to be constant 
along the extremals of the problem. 

Example 3.7. Under the hypotheses X; (Axi) = \ a Xi (xi), a s K\ {1}, prob- 
lem (10) is invariant under 



t s = ht(t) = c- 2s t, h s xi ( Xl (t s )) = e^* Xl (t) , h s X2 (x 2 (t s )) = e^" 1 )' 
with uf(t s ) = e s Ui(t) and $ s = 0. We conclude from Theorem 3.3 that 

3a 



x 2 (t) , 



Mt)- 



1 iW ' " w \a - 1 
holds along any extremal of the problem (hOl 



1 I X2(t) + 2Ht = constant 



It is interesting to note that Theorem 3.3 cover both normal and abnor- 
mal situations. This is an important issue because abnormal minimizers while 
nonexistent for the basic problem of the calculus of variations, in general La- 
grange problem they may occur frequently. This is the case, for example, for 
the problems in Sub-Ricmannian Geometry. 

Even for the basic problem of the calculus of variations the results are new 
and provide new information. As far as the notions of invariance, conserved 
quantity along the extremals and reduction belong to the most important tools 
in the study of classical mechanics, it is not surprising that the conserved quan- 
tities obtained by Theorem |3.3| may be very useful in practice. We remark that 
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solving the Hamiltonian system by the elimination of the control, with the aid 
of the maximality condition, is typically a difficult task. The existence of such 
conserved quantities are a circumstance which may make the resolution process 
easier and are often useful for purposes of analyzing a nonlinear control system. 
We shall see in the next section that the conserved quantities obtained by The- 
orem 3.3 are also useful to establish Lipschitzian regularity of the minimizing 
trajectories. 



4 Tonelli Full-Regularity 

In this section we address the question: How to assure that the set of extremals 
include the minimizers predicted by the existence theory? 

It is easy to find examples of the optimal control problem (P), very simple 
in aspect, for which the application of the Pontryagin maximum principle gives 
a unique function u(-) which is not an optimal control. This happens because 
the optimal solution does not exist. One cannot conclude that we have found 
the solution unless we know a priori that a solution really exists. 

A general existence theory for the calculus of variations has been introduced 
by Leonida Tonelli, in a series of Italian papers, as from 1911, when he was 26. 
The first general existence theorem for optimal control was given by Filippov. 
The original paper, in Russian, appeared in 1959. There exist now an extensive 
literature on the existence of solutions to problems of optimal control. The 
following set of conditions, of the type of Tonelli, guarantee the existence of 
minimizer for our problem (P). It is called a Tonelli type existence theorem 
because for the basic problem of the calculus of variations one has <p = u and 
the theorem coincides with the classical Tonelli existence theorem. 

Theorem 4.1 ("Tonelli" Existence Theorem for (P)). Problem (P) has an 
absolute minimum in the space u(-) £ L\, provided that there exist at least one 
admissible pair, and the following conditions are satisfied for all (t,x,u): 

• Coercivity: there exists a function 9 : M.q — ► R, bounded below, such that 

lim = +oo , 

r — >+oo T 

L(t,x,u)>9(\\<f(t,x,u)\\) , 

lim \\<p(t, x, u)\\ = +oo; 
IMH+oo 



• Convexity: L (t, x, u) and tp (t, x, u) are convex with respect to u. 

Roughly speaking, the theorem asserts that under convexity and coercivity, 
a solution exists in the class of integrable controls. For the basic problem of the 
calculus of variations one has x = u and this mean that existence is given in 
the class of absolutely continuous functions, possible with unbounded derivative. 
We note that the assumptions on the solution for the derivation of the necessary 
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optimality conditions have more regularity than the one considered here. For 
example, for the basic problem of the calculus of variations, the biggest class for 
which the Euler-Lagrange equation is valid is the class of Lipschitzian functions, 
that is, the class of absolutely continuous functions having essentially bounded 
derivative. The steps for the derivation of the the Euler-Lagrange equations 
can no longer be justified in the class of absolutely continuous functions. So 
the central question, which immediately comes to mind, is the following: How 
different is the problem with controls in L\ from the problem with the controls 
in Loo? It seems that in order to apply the standard approach to solving op- 
timization problems, one needs an intermediate step between existence, which 
is proved for controls in L\, and standard classical necessary conditions, which 
are valid for controls in L^. Is this intermediate step really necessary? Is this 
a technical phenomenon or does it reflect a fundamental difficulty? Can the 
solution predicted by Tonelli's existence theorem be irregular and fail to satisfy 
the Pontryagin maximum principle? Tonelli proved, for the basic problem of 
the calculus of variations in the scalar case (n = 1), that bad behaviour is only 
possible in a closed set of measure zero. It turns out that, as has been shown 
by F. H. Clarke and R. B. Vinter |33|, Ch. 11], that the result is general. 

Theorem 4.2 ("Tonelli" Regularity). Assume that the Tonelli Existence Hy- 
potheses are satisfied. Take any minimizer (£(•), &(•)) of (P). Then there exists 
a closed subset C [a, b] of zero measure with the following property: for any 
t G [a, b] \ u(t) is essentially bounded on a relative neighborhood ofr. 

The theorem asserts that the optimal solutions predicted by Tonelli's exis- 
tence theorem satisfy the Pontryagin maximum principle or the Euler-Lagrange 
equations everywhere, except possibly at the points of a closed exceptional set 
of measure zero. Tonelli, against the general opinion that, at least for "reason- 
able" problems, all minimizers predicted by his existence theorem are extremals, 
conjectured the possibility of the f2 set to be nonempty and the possibility of 
such a minimizer tt(-) to be unbounded and fail to be an extremal. It has been 
proved in 1984 by J. M. Ball and V. J. Mizel j| that in general the Q set can not 
be taken to be empty, even for very "reasonable" problems. Even for polynomial 
Lagrangians and linear dynamics, minimizers predicted by Tonelli's existence 
theorem may fail to be Pontryagin (or Euler-Lagrange) extremals. Given this 
possibility, the natural question to ask now is the following: How to exclude the 
possibility of bad behaviour? How to obtain full-regularity (fl = 0)? This is 
achieved by postulating conditions beyond those of Tonelli's existence theorem, 
assuring that all optimal controls are essentially bounded. These conditions 
close the gap between the hypotheses arising in the existence theory and those 
of necessary optimality conditions, assuring that the solutions can be identified 
via the Pontryagin maximum principle. As far as ip is bounded on bounded 
sets, it also follows that the optimal trajectory is Lipschitzian and, similarly, 
the Hamiltonian adjoint multipliers ip of the Pontryagin maximum principle 
turn out to be Lipschitzian cither. Thus, full-regularity justifies searching for 
minimizers among extremals and establishes a weaker form of the maximum 
principle in which the Hamiltonian adjoint multipliers are not required to be 
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absolutely continuous but merely Lipschitzian. With the Lipschitzian regularity 
in hand, other regularity properties follow easily, like C 1 or C 2 , or even C°° , 
imposing some more additional conditions. Full- regularity conditions also pre- 
cludes occurrence of undesirable phenomena, like the Lavrentiev one, making 
possible the implementation of efficient discretization schemes and algorithms 
for numerical computation of the optimal controls. Again, such undesirable phe- 
nomena are possible even when the Lagrangian is a polynomial and the control 
system is linear ft5f| . 

The regularity condition one most often finds, implying that the minimizing 
controls are bounded, was suggested by Tonclli himself. Tonclli and Morrey 
proved that under the growth conditions 

\\L X \\ + \\L U \\ < c \L\ + k , (22) 

c > and k constants, points of bad behaviour cannot occur for the basic 
problem of the calculus of variations: under conditions ( p2| ) all optimal controls 
predicted by Tonelli's existence theorem are bounded and the corresponding 
minimizing trajectories Lipschitzian. The conditions impose global growth hy- 
pothesis on the derivatives of the Lagrangian L with respect to the state and 
control variables. F. H. Clarke and R. B. Vinter have shown that the bound on 
the derivatives of the Lagrangian with respect to the control variables can be 
discarded, and that regularity conditions 

\\L X \\ <c\L\ + k, 

of the type of Tonclli-Morrey, hold not only for the basic problem but universally 
in the calculus of variations |3^, Ch. 11]. We will see that Tonelli-Morrey-type 
regularity conditions apply in fact more generally: they hold in the generic 
context of optimal control. They hold even when the dynamics are nonlinear 
both in the state and control variables. 

The literature on regularity conditions for the problems of the calculus of 
variations is now vast, but for the problems of optimal control, if one excludes the 
special cases that can be easily recast as problems in the calculus of variations, 
regularity conditions are a rarity. The first results appeared in 2000 and treat 
the case of control-affine dynamics: 



Theorem 4.3 ([19]). For the Lagrange Problem of Optimal Control (P) with 
control affine dynamics, tp — f{t, x) + g(t, x) u, if g (t, x) has complete rank r 
for all t and x; the coercivity condition holds; and 3 7 > 0, [3 < 1, r\, and 
[i > max {(3 — 2, —2}, such that 

(\L t \ + \L x ,\ + \\L^ t -L t ip\\ + \\L^-L x ^\\) \\uf < 1 L^ + i 1 , (23) 

then all the minimizers u (•) of the problem, which are not abnormal extremal 
controls, are essentially bounded on [a, 6]. 



The proof of Theorem |4.3| is based on the reduction of problem (P) to 
problem (|l2| ) with Y(t, z, v) — L( ^ z ^ ; on the subsequent Gamkrelidze's com- 
pactification of the space of admissible controls p0|, §8.5]; on the abnormal- 



Caratheodory-equivalence given by Theorems |2.5| and 2.6; and utilization of 



20 



the classic Pontryagin maximum principle and the time-invariance property of 
problem @. We remark that conditions (E3h are not of the type of Tonclli- 
Morrey, and even for the basic problem of the calculus of variations one can 
cover new situations [|l9| ^ . The only drawback is that in order to cover new 
situations the regularity conditions become harder to verify. For the case of 
control-affine dynamics this is not a problem, and it is possible to deal pretty 
well with the conditions. In [|l9| other conditions, not so general as (23|), more 
strong, but more easy to check in practice, were obtained. Theorem L3] admit 
a generalization for Lagrange problems with dynamics which are nonlinear in 
control, introducing generalized controls and making a reduction of the nonlin- 
ear dynamics to the control affine case by relaxation, a technique introduced 
by R. V. Gamkrelidze. The only problem, with this nice approach, is that 
the conditions become cumbersome. We must not forget that checking regu- 
larity conditions is a preliminary step in the process of solving a problem, and 
that, by definition, regularity conditions must be simple to verify. To go to 
the general nonlinear case with verifiable regularity conditions, a new technique 
is needed. Such technique was introduced by the author in (3^], showing that 
Tonelli-Morrey type conditions work universally in optimal control: 



Theorem 4.4 ([p0|). Coercivity plus the growth conditions: 
stants c > and k such that 



there exist con- 



dh 



dt 

dip 



dt 



<c\L\ + k, 

< c |Ml + fc, 



dL 



dx 
dip 



dx 



<c\L\ + k, 
< c\<fi\ + k (i = 1, 



(24) 



n) 



imply that all minimizers u{-) of (P), which are not abnormal extremal controls, 
are essentially bounded on [a, b] . 



The Lipschitzian regularity conditions (24) are obtained using the applicabil- 
ity conditions ([5J) of the Pontryagin maximum principle to the auxiliary problem 
(P T ) introduced in Section |[ Theorem L4 is then proved using the theorem 
of Emmy Noether and the established abnormal-Caratheodory-equivalence be- 
tween problems (P) and (P T )- The theorem covers the general optimal control 
problem (P), providing conditions of the type of Tonelli-Morrey under which 
non-abnormal optimal controls are bounded. This guarantees the Lipschitzian 
regularity of the non-abnormal minimizing trajectories and that all minimizers 
are Pontryagin extremals. 



Corollary 4.5. Under the hypotheses of Theorem J.-4t a ^ minimizers of (P) 
are Pontryagin extremals. 



We remark that convexity is not required in Theorems |4.3| and 4.4 in order 



to establish the Lipschitzian regularity of the (non-abnormal) minimizing tra- 
jectories x(-). This fact is important because existence theorems without the 
convexity assumptions are a question of great interest. 
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It is also possible to obtain new regularity conditions, which are not of the 
type of Tonelli-Morrey, for the generic nonlinear problem (P) |30| . 

I found pertinent to quote Constantin Caratheodory addressing the question 
of The Beginning of Research in the Calculus of Variations || : "I will be glad 
if I have succeeded in impressing the idea that it is not only pleasant and 
entertaining to read at times the works of the old mathematical authors, but 
that this may occasionally be of use for the actual advancement of science." 
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